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CLAIMS 

What is claimed is: 

1 . A method for unifying speech user interface and graphic user interface commands, 
comprising the steps of: 

receiving grammar specifying a syntax of at least one speech command and 
having semantic information; and 

processing the grammar to extract the semantic information for use with both a 
graphical user interface and a speech user interface. 

2. The method of claim 1, wherein the method further comprises the step of 
generating graphical user interface elements corresponding to the semantic 
information in the grammar. 

3. The method of claim 1, wherein the method further comprises the step of 
generating speech grammar from the grammar and semantic information. 

4. The method of claim ) , wherein the method further uses the grammar and the 
semantic information to generate visual graphical user interface elements required to 
implement a set of commands contained in the grammar. 

5. The method of claim 1, wherein the step of processing further comprises 
processing the semantic information to generate semantic directives used for parsing 
the grammar between the graphical user interface and the speech user interface. 
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6. A method for unifying speech user interface and graphic user interface commands, 
comprising the steps of: 

receiving user entered text via a graphical user interface; 
processing the user entered text via the graphical user interface; 
monitoring the user entered text and adding input context to the user entered 
text; and 

updating a speech recognizer with the user entered text and semantic 
information. 

7. The method of claim 6, wherein the step of updating the speech recognizer 
comprises the step of accepting new text information and input context to augment 
and update a speech grammar and recognition vocabulary of the speech recognizer. 

8. The method of claim 6, wherein the method further comprises the step of updating 
the graphical user interface. 

9. The method of claim 8, wherein the step of updating the graphical user interface 
comprises the steps of updating graphical user interface directives and elements to 
maintain the graphical user interface unified with the speech grammar. 

10. The method of claim 6, wherein the method further comprises forming a window 
for displaying a speech interface command as it is being built using the graphical user 
interface. 

1 1 . A system having a unified speech user interface and graphical user interface, 
comprising: 

a display for providing an output for graphic user interface elements; and 
a processor coupled to the display, the processor programmed to: 

receive grammar specifying a syntax of at least one speech command 
and having semantic information; and 
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process the grammar to extract the semantic information for use with 
both a graphical user interface and a speech user interface. 

12. The system of claim 1 1, wherein the processor is further programmed to generate 
graphical user interface elements corresponding to the semantic information in the 
grammar. 

13. The system of claim 1 1, wherein the processor is further programmed to generate 
speech grammar from the grammar and semantic information. 

14. The system of claim 1 1, wherein the processor is further programmed to use the 
grammar and the semantic information to generate visual graphical user interface 
elements required to implement a set of commands contained in the grammar. 

15. The system of claim 1 1, wherein the processor is further programmed to process 
the semantic information to generate semantic directives used for parsing the grammar 
between the graphical user interface and the speech user interface. 

16. A system having a unified speech user interface and graphical user interface, 
comprising: 

a display for providing an output for graphic user interface elements; and 
a processor coupled to the display, the processor programmed to: 

receive user entered text via a graphical user interface; 

process the user entered text via the graphical user interface; 

monitor the user entered text and adding input context to the user 
entered text; and 

update a speech recognizer with the user entered text and semantic 

information. 

1 7. The system of claim 16, wherein the processor is further programmed to update 
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the speech recognizer by accepting new text information and input context to augment 
and update a speech grammar and recognition vocabulary of the speech recognizer. 

18. The system of claim 16, wherein the processor is further programmed to update 
the graphical user interface by updating graphical user interface directives and 
graphical user elements to maintain the graphical user interface unified with the 
speech grammar of the speech user interface. 

19. The system of claim 16, wherein the processor is further programmed to form a 
window in the graphical user interface enabling the display of a speech interface 
command as a user constructs the speech interface command. 

20. A machine readable storage, having stored thereon a computer program having a 
plurality of code sections executable by a machine for causing the machine to perform 
the steps of: 

receiving grammar specifying a syntax of at least one speech command and 
having semantic information; and 

processing the grammar to extract the semantic information for use with both a 
graphical user interface and a speech user interface. 

21 . A machine readable storage, having stored thereon a computer program having a 
plurality of code sections executable by a machine for causing the machine to perform 
the steps of: 

receiving user entered text via a graphical user interface; 
processing the user entered text via the graphical user interface; 
monitoring the user entered text and adding input context to the user entered 
text; and 

updating a speech recognizer with the user entered text and semantic 
information. 
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